Tagging objects in augmented reality to track object data

ABSTRACT

There are provided systems and methods for tagging objects in augmented reality to track object data. A user may capture visual data utilizing a device at a location, where the visual data includes one or more objects that the user may wish to associate with a purchase or sell offer. A device may perform object recognition to identify the object and an identifying characteristic of the object. A service provider may then receive offer details and may generate a graphical object or other virtual data that can be displayed with the object in an augmented reality experience. Later, when the object is identified in another augmented reality experience on a different device, the virtual graphic may be displayed, which may show the offer for the object. Further, the augmented reality may be used to process a transaction for the object and track the object.

TECHNICAL FIELD

The present application generally relates to augmented reality, and morespecifically to an augmented reality that allows users to tag objectswith virtual tags that may allow owners of the objects to track theobject's data.

BACKGROUND

Various types of service providers may provide augmented reality forcertain uses, including overlaying graphical objects over real-worldimages so that additional data may be seen with real-world images. Thisaugmented reality may allow users to play games, interact with otherusers in a virtual environment, and perform other services.Additionally, these service providers may provide other services tousers, including electronic transaction processing to users. However,objects in an augmented reality may be difficult to track where theobjects may move, such as vehicles, personal items, or users. Moreover,the other services of the service provider may not allow for tracking ofdata in a manner that can be easily displayed with the objects. Thus,users may be unaware of particular information associated with anobject, such as items or property that user may own.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a networked system suitable forimplementing the processes described herein, according to an embodiment;

FIG. 2A is an exemplary interface of a communication device displayingan augmented reality where a user is tagging an object with provideddata, according to an embodiment;

FIG. 2B is an exemplary interface of a communication device displayingan augmented reality having tracked object data, according to anembodiment;

FIG. 3 is an exemplary system environment showing a communication deviceand a service provider server interacting to provide an augmentedreality to track object data, according to an embodiment;

FIG. 4 is a flowchart of an exemplary process for tagging objects inaugmented reality to track object data, according to an embodiment; and

FIG. 5 is a block diagram of a computer system suitable for implementingone or more components in FIG. 1, according to an embodiment.

Embodiments of the present disclosure and their advantages are bestunderstood by referring to the detailed description that follows. Itshould be appreciated that like reference numerals are used to identifylike elements illustrated in one or more of the figures, whereinshowings therein are for purposes of illustrating embodiments of thepresent disclosure and not for purposes of limiting the same.

DETAILED DESCRIPTION

Provided are methods utilized for tagging objects in augmented realityto track object data. Systems suitable for practicing methods of thepresent disclosure are also provided.

According to various embodiments, a user may utilize a communicationdevice while traveling through a real-world environment to captureimages, including video or three-dimensional scans of real-world objectsand environments. The user may view an item, such as a real-world objectthat the user would like to purchase, which may correspond to property(e.g., a home) or moveable property and items, including vehicles,personal property, and the like. The user may capture the real-worldobject through an augmented reality experience, scene, or environmentthat records real-world images of a real-world environment, displaysthose images, and overlays graphics onto the images so that virtualgraphics, graphics, icons, or other information may be displayed with,over, next to, and/or associated with the real-world objects. Forexample, an augmented reality experience may be universal over multipledevice so as to provide, through one or more devices, capturedreal-world images, video, or scans with various visual indicators,graphical objects, and other virtual data. This creates an experiencethat includes both real and virtual data. Thereby, a device may generatea digital scene that includes a mix or real and virtual graphics. Whenviewing the real object, the user may decide to make on offer onpurchase of the object. In other embodiments, the user may be a sellerand may add a sale offer to the object. The user may input data for theoffer and the offer may be attached to the object. For example, the usermay specify, or a service provider may determine, one or moreidentifying characteristics of the object from the visual data capturedin the augmented reality experience. The characteristic may correspondto a geo-location, identifying mark, identifier, or other informationabout the object. These identifying characteristics may be used togenerate an object “fingerprint” that correspond to the identifyingcharacteristics that collectively may be used to identify the object incaptured visual data. The service provider may generate a virtualgraphic or graphic for the augmented reality. This may be stored withthe identifying characteristic so that when the object is againidentified in the augmented reality experience by the user's device oranother user's device, the graphic may then be displayed. For example,the graphic may include an overlay the graphic on or with the images ofthe real-world object so that the offer can be seen with the real-worldobject by the user or a different user's device including the device ofthe owner of the object. The augmented reality may further be used toelectronically process a transaction between the buyer and seller. Thus,a service provider may provide output of a dynamically generated anddisplayed augmented reality, which allows specific data to be trackedwith an object so that multiple disparate users may see the data.

In order to buy or sell items through virtual graphics in an augmentedreality, a user may create an account with a service provider. The usermay be required to provide personal or other identification informationto establish the account, such as a name, address, and/or otherinformation. The user may also be required to provide financialinformation, including payment cards (e.g., credit/debit cards), bankaccount information, gift cards, and/or benefits/incentives, which maybe utilized to provide payments or otherwise engage in processing ofanother transaction. In order to create an account, the user may berequired to select an account name and/or provide authenticationcredentials, such as a password, personal identification number (PIN),security questions, and/or other authentication information. The serviceprovider may utilize such information to create the account for the userand provide the user with a digital wallet to the user that allows forelectronic transaction processing. The digital wallet may store theuser's financial instruments of the user and allow the user to processtransactions through the digital wallet. In this regard, the serviceprovider may provide a digital token, such as a data package, thatrepresents the digital wallet and may approve the digital wallet forprocessing of a transaction with the service provider to a device thatreceives the token. Thus, the token may include data identifying thedigital wallet (e.g., a token), as well as authentication informationincluding an identifier for user of the digital wallet, which may beencrypted. The account may also include a device identifier or othercontact information for the user so that the user may be contacted tocomplete a transaction for an item tagged in an augmented reality.

Once an account is created, the account may be accessed through a webbrowser from a website of the service provider and/or a dedicatedapplication of the service provider, such as a mobile smart phoneapplication. The application (or website) may be associated with apayment provider, such as PayPal® or other online payment providerservice, which may provide payment services. The application may executeon the computing device for a user and may provide variousfunctionalities and processes to the user. For example, a user mayutilize the account through the website or a device application thatallows for tagging of real objects in an augmented reality withadditional data for an offer for sale of the item. In this regard, theuser may utilize a communication device to capture visual content orother data including a representation of one or more items. Image,video, or other audiovisual data at a real-world location may capture arepresentation of an item as an object within a real-world environment.The user's communication device may include a camera, microphone, orother input device that may be used to capture visual data of areal-world scene that includes the item or other object, such as animage or video of the object as well as other nearby objects in thereal-world environment. In order to identify object within theenvironment, various visual data captured by the camera of the devicemay be used. Within an image or video, the representations, locations,and visual data of object may be used to determine identifyingcharacteristics, marks, or other data of the object that allows fortracking and/or identification of the object to other devices.

For example, the video or other image data may be required to beprocessed to determine and/or recognize the object. Visual data (e.g.,images and/or videos, including three-dimensional scans) capturing oneor more objects may be processed to recognize the object within theimage by determining which object is selected in the visual data and acharacteristic that may be used to recognize the object in the future toother devices and servers. One or more image processing techniques andrecognition algorithms may be utilized to determine an object withinvisual data, including object recognition. The object of interest to auser may be designated with physical cues, such as pointing to an objector location within the environment. The physical cues may further beutilized to perform additional data input including creating an offerfor an object of interest (e.g., by circling the object or drawing acertain symbol), as well as increasing an offer previously created bythe user or another user (e.g., an up gesture, such as a “thumbs up”sign). This may allow the user to utilize gestures to perform multipleactions within the augmented reality application and environment.

Other data may be used to identify the environment and/or items, forexample, audio data, including verbal statements, may identify the itemand/or the environment or other data necessary to identify the item. Animage processing and/or object recognition process may be used toidentify the object through comparison of the captured data to otherimages/video and/or analysis of the data using known item features,landmarks, or other signifying data points. For example, object featuredata may be extracted, which may include distances between signifyingpoints or points of interest in the visual data. Depth or width of thesesignifying points or image landmarks may be extracted, as well as a sizerelative to other features in the visual data. Other data points mayalso be determined in the visual data, which may include other featuresof note. For example, particular objects may have an identifyingcharacteristic or mark, such as a scratch or license plate on a vehicle,a color, numbers or letters on the object, and other information. Thismay include wording on the object, a logo or tag, a barcode or QR code,a location relative to other objects, or other data including a color ofthe item, environmental information in the visual data, contrast and/orlighting in the visual data, and other context related data for thevisual data. Thus, computer algorithms, image processing techniques,and/or machine learning processes may be utilized to determine andidentify an item in visual data captured by the first user. Thus, theidentifying characteristic may include further data than just an objectshape or scan, which may be used to more specifically determine theparticular object.

Additionally, the visual data may be accompanied by metadata that may beused by the service provider to identify and track the particularobject. For example, the communication device capturing visual data at alocation may determine a location of the user, device, and/or objectthrough a GPS module or locator associated with the device. This may beappended to the visual data as metadata, which may be transmitted to theservice provider with the visual data. In some embodiments, the metadatamay include a timestamp of the visual data that is captured with thevisual data. The timestamp may be used to track the object based onprobability analysis that the object has moved a certain distance froman initial geo-location where the object is tagged. For example, abicycle or car may only be capable for traveling a certain distance fromits location. Thus, if a similar object is later captured but too farfor the original object to travel, then the similar object is unlikelyto be the original object. The probability may be based on a machinelearning model generated from one or more past travels of the object orsimilar object and types. Additionally, the machine learning model mayutilize known locations of travel or identification of the object todetermine whether the objects in different augmented reality visual dataat different times are the same object. For example, a first user maycapture the object at a first location and make an offer. Later a seconduser may also capture the object at a second location, where the objectis determined to be the same as the object at the first location. Theseidentifications, with additional identifications, may be used to build amodel of known locations of the object for higher probabilisticdetermination of the object when located at known locations. Further, ageofence of probable locations of the object may be generated based onthe detected locations for use with the machine learning model.

The model may also be weighted based on available data, such as traffic,road maps, demographics, user information (e.g., employment, past travelroutes, etc.) and other information. The machine learning model may alsoutilize the extract feature data, such as the identifyingcharacteristics of the captured object, to determine if the object isthe same (or similar) to the original object. Thus, the location datamay be utilized with the extracted feature data by a machine learningmodel with additional identifying characteristics when identifyingobjects in visual data. Thus, information in the visual data that may beused to determine a corresponding object may include text within theimage, color, contrast, lighting, geographic location, time of captureof the visual data, audio within the visual data, or other data withinthe visual data or associated with the visual data, such as metadata. Inthis regard, different items may be sold in different flavors, types,brands, or other versions in specific locations, which may be detectedbased on color, description on packaging, geographic location, or otherinformation. The feature data, location(s), timestamp(s), and other datamay collectively be utilized to generate an object fingerprint that isthen utilized to identify the object when captured in the augmentedreality experience through the probabilistic machine learning model.

Once the object in the captured data is determined, the service providermay receive a request to attach an offer to the object, such as an offerto purchase the product or a sale offer to sell the product (e.g., by abuyer or seller, respectively, of the object). For example, the user mayutilize their device to select the object within an augmented realityexperience, where the object is then identified and the user may provideadditional input (and/or the service provider may request the input) forthe offer. The additional input may correspond to an amount for theoffer, as well as a description of the offer, object, or location.Additionally, the input may include a contact identifier, such as aphone number, messenger name, or other data that allows the owner of theobject to respond to the offer or allows a buyer of the object tomessage the seller and make an offer. The input and also include aselection of a particular virtual graphic, such as a box, speech bubble,highlighting, or other graphical object that can be overlaid on an imageof the real object in further images of real-world environment of thereal object so that other users can view the offer.

Using this input, the service provider may then generate anitem/object-specific visual indicator, change, or modification of thereal object for use with the augmented reality. The virtual graphic forthe augmented reality may correspond to a visual change of the displayor output of the in the augmented reality. The visual indicator ormodification of the object may correspond to a graphic object overlaidonto the object and may adjust output parameters for the item, such aspixels, resolution, size, brightness settings, color gradient, etc. Forexample, the indicator or modification may be done by one or more ofhighlighting, adjusting a color gradient, adjusting a brightness of theitem, or adding some graphic to the object when the object is viewed inan augmented reality experience. The indicator may also correspond totext overlaid onto the object or placed nearby the object. Thus, avisual indicator may be displayed as a graphic overlaid onto therepresentation of the item in the displayed environment, such as ahighlight of the item, a box around the item, a pointer to the item, orother information. A modification may also be displayed by modifyingdisplay values for the representation of the item in the output data.The visual indicator or modification may also be selectable and may beinteracted with through one or more input device of the communicationdevice, for example, to pull up object or offer information.

Thereafter, an augmented reality experience having the environment withone or more computer generated graphics or other data may be output toother users, including the owner of the item or other potential buyersof the item that utilize their computing device. The user may interactwith the augmented reality to view particular data for the offer, aswell as respond to the offer. In order to identify the object to otherdevices, for example, where the object may move and/or where a seconduser may then visit the location of the object, the identifyingcharacteristic(s) of the object may be used with an object recognitionsystem. For example, an identifying mark (e.g., physical marking on theobject) may be used to identify the object. In addition, a geo-locationmay be used if the object is stationary or has been since the object waslast imaged in the augmented reality experience. Where the object may bemobile, a timestamp of when the object was first or last imaged in theaugmented reality experience and a current time of imaging the objectmay be used to determine whether the currently imaged object is likelyto be the same as the previously imaged object. For example, aprobabilistic model may be utilized with a machine learning engine todetermine if the mobile object is likely to still be within the samearea or radius. The probabilistic model may also be based on otheravailable data, such as weather, traffic, and the like. Using the model,the service provider may predict whether it is possible for the objectto have traveled at the current geo-location of the object. For example,if the object is originally captured in the augmented reality at 4:00 PMat a first geo-location and a similar object captured at 4:15 PM but 60miles from the first geo-location at a second geo-location, the serviceprovider may utilize the probabilistic model to determine there is a lowlikelihood the objects are the same. Thus, a threshold percentage orlevel may be required to be exceeded before determining that the objectspotentially match.

If the object is identified and matched, the virtual graphic or graphicfor the offer may be displayed in the augmented reality experience onthe second device. In various embodiments, a device of the second usermay correspond to a wearable computing device, which may present theindicators or other data in the augmented reality. For example, wearableeyeglasses with associated computing devices may present the augmentedreality when the second user is viewing or in an environmentcorresponding to the item. In other embodiments, the output data may bedisplayed when the second user is viewing the item in the augmentedreality through an application executing on a device, which may beoverlaid in the website or application interface presented through thedevice interface. The second user may then interact with the offer, suchas by viewing information and terms for the offer. The offer may alsoallow the second user to contact the first user to accept the offer,provide a counter offer, or otherwise perform a sale/purchase of theobject.

In some embodiments, the object may correspond to an object that has notbeen put up for sale by the owner of the object. In such embodiments,the owner may prefer to not sell the item, and may select “Don't want tosell,” or similar options within the augmented reality experience. Thismay alert the potential buyer that the owner does not want to sell theobject using the contact identifier. Further, this action by the ownermay further prevent additional offers for the object by other users,including adjusting the augmented reality experience to prevent offers(e.g., greying out the item or blurring, adding a graphic, etc.). Insome embodiments, the augmented reality graphic may be displayed to thesame user or other users with additional information provided by theseller, the owner, or other users. For example, the seller and/or ownermay add a reserve price and/or auction date or time that is added to theaugmented reality graphic. This information may be displayable to thepotential buyer and/or other users when viewing the augmented realitygraphic. In some embodiments, the service provider providing theaugmented reality experience may receive correspondence from thebuyer(s) and/or seller/owner. In such embodiments, the correspondencemay be analyzed to suggest or add a reserve price, sale price, orauction time period for the object.

Additionally, the offer and other offers for the object or similarobjects may be stored to a distributed ledger on multiple differentdevices so that a blockchain of records for offers for the object may begenerated. This allows the offers (including the virtual graphic for theaugmented reality experience) for the same or similar objects to beretrievable by different devices and also stored in distributed recordsthat allow for additional trust as the distributed records are moredifficult to tamper with without being revised based on other records inthe blockchain ledger. Electronic transaction processing may then beperformed for the object between the users using an online transactionprocessor and the data for the virtual graphic within the augmentedreality. The accounts of the users may be used to send and receivefunds. In this regard, an account may further be linked to the offer,virtual graphic, and/or real-world object so that buying and selling ofthe object may occur through the augmented reality using the transactionprocessor.

In this regard, an augmented reality view or experience may be generatedthat provides object data to a user that would normally not be visibleto a user when viewing real-world or online data. Thus, a communicationdevice may assist in data determination and output of visual datathrough performing object recognition and image processing that assistin presenting the augmented reality. Additionally, the augmented realitymay be used to track objects as the objects move through a real-worldenvironment such that tagged data within the augmented realityexperience may attach to the object and allow other users to viewvirtual graphics for the data. This allows for automated generation ofthe augmented reality on other devices that provides for tracking andisplaying data virtually and without users being required to search forand request data. Further, by using a distributed ledger for the virtualgraphics and other data, the data may be more trustworthy as tamperingwith the data may be much more difficult.

FIG. 1 is a block diagram of a networked system 100 suitable forimplementing the processes described herein, according to an embodiment.As shown, system 100 may comprise or implement a plurality of devices,servers, and/or software components that operate to perform variousmethodologies in accordance with the described embodiments. Exemplarydevices and servers may include device, stand-alone, andenterprise-class servers, operating an OS such as a MICROSOFT® OS, aUNIX® OS, a LINUX® OS, or other suitable device and/or server based OS.It can be appreciated that the devices and/or servers illustrated inFIG. 1 may be deployed in other ways and that the operations performed,and/or the services provided by such devices and/or servers may becombined or separated for a given embodiment and may be performed by agreater number or fewer number of devices and/or servers. One or moredevices and/or servers may be operated and/or maintained by the same ordifferent entities.

System 100 includes a client device 110 and a transaction processorserver 130 in communication over a network 150. A user (not shown) mayutilize client device 110 to utilize the various features available forclient device 110, which may include processes and/or applicationsassociated with transaction processor server 130 to view an augmentedreality experience provided by one or more augmented realityapplications and tag real-world objects within a real-world environmentwith virtual data that may track with the object and be presented toother users. The user may utilize client device 110 to capturereal-world visual data. The data may then be marked by users, includingby setting sale or purchase offers, which may be used to generate avirtual graphic, such as a visual indicator, for the augmented realityexperience. The virtual graphic or other virtual visual indicator maythen be stored with one or more identifying characteristics of theobject so that other devices capturing the augmented reality may thenview the virtual graphic with the real-world object through theaugmented reality experience.

Client device 110 and transaction processor server 130 may each includeone or more processors, memories, and other appropriate components forexecuting instructions such as program code and/or data stored on one ormore computer readable mediums to implement the various applications,data, and steps described herein. For example, such instructions may bestored in one or more computer readable media such as memories or datastorage devices internal and/or external to various components of system100, and/or accessible over network 150.

Client device 110 may be implemented as a communication device that mayutilize appropriate hardware and software configured for wired and/orwireless communication with transaction processor server 130. Forexample, in one embodiment, client device 110 may be implemented as apersonal computer (PC), telephonic device, a smart phone, laptop/tabletcomputer, wristwatch with appropriate computer hardware resources,eyeglasses with appropriate computer hardware (e.g. GOOGLE GLASS®),other type of wearable computing device, implantable communicationdevices, and/or other types of computing devices capable of transmittingand/or receiving data, such as an IPAD® from APPLE®. Although only onecommunication device is shown, a plurality of communication devices mayfunction similarly.

Client device 110 of FIG. 1 contains an augmented reality application120, transaction application 112, other applications 114, a database116, and a network interface component 118. Augmented realityapplication 120, transaction application 112, and other applications 114may correspond to executable processes, procedures, and/or applicationswith associated hardware. In other embodiments, client device 110 mayinclude additional or different modules having specialized hardwareand/or software as required.

Augmented reality application 120 may correspond to one or moreprocesses to execute software modules and associated devices of clientdevice 110 to receive or record visual data and process the visual datato determine an identification of an object in an environment andassociated item data, as well as generate, alter, or interact with avisual indicator or other visual modification of the object in theenvironment through an augmented reality output. In this regard,augmented reality application 120 may correspond to specialized hardwareand/or software utilized by a user of client device 110 that firstreceives, captures, and/or records video data, including audiovisualdata that includes audio data that may also be processed to determineitem identifications in the environment. Augmented reality application120 may utilize a camera or other optical/visual data capturing deviceof client device 110. For example, the visual data capture device maycorrespond to at least on optical or visual capture device of clientdevice 110 enabling a user associated with client device 110 to captureor record images, including still and/or video images. Input devices maycorrespond to a digital camera on client device 110 (e.g., incorporatedin client device 110 such as a mobile phone's digital camera in atraditional camera orientation and/or a forward facing cameraorientation that captures one or more users as they use and view adisplay screen of client device 110) or associated with client device110 (e.g., connected to client device 110 but incorporated within a bodyor structure of client device 110), or may more generally correspond toany device capable of capturing or recording an image, video, or otherdigital media data.

As a digital camera, input devices may include a sensor array disposedon a semiconductor substrate having a plurality of photosensitiveelements configured to detect incoming light. In other embodiments,other types of electromagnetic radiation sensors may be used, includinginfrared sensitive sensors/elements and the like. A camera of inputdevices may include various features, such as zoom, flash, focuscorrection, shutter speed controls, or other various features usable tocapture one or more images or videos of the user and/or other users orobjects. Input devices may include other media capture components,including a microphone to capture audio data. Input devices may furtherdisplay a preview and/or captured image to the user through anotherdevice of client device 110, such as a viewfinder, screen (e.g., mobilephone touch screen, tablet touch screen, and/or personal computermonitor), or other display. Input devices may interface with one or moreapplications of client device 110 to capture visual media data, such asimages/videos, and may output an augmented reality of the capturedvisual media data to provide budgetary recommendations and alterationsof item appearances in the visual data based on the budgetaryrecommendations.

The captured visual data may include real-world data, which may includea visual representation of one or more real-world objects. Objectidentification may be determined through received the visual data forone or more objects in an environment in image or video data thatprovides contextual data allowing for identification of the object. Forexample, augmented reality application 120 may allow a user to select aportion of an image of video to highlight an object or select the objectfor interacting with in an augmented reality experience including thevisual data of the real-world and virtual graphics or visual indicatorsadded by augmented reality application and/or transaction processorserver 130. Once the object has been selected for interaction, augmentedreality application 120 provide the data to transaction processor server130 for determination of an identifying characteristic of the object,which may be used to track the object as the object moves and/or asother devices capture the object through another augmented realityapplication, scene, and/or experience. However, augmented realityapplication 120 may also provide the determination of thecharacteristic, which may include allowing a user to select thecharacteristic and/or provide input of a mark on the object. In someembodiments, the identifying characteristic may correspond to ageo-location, a time of capture of the visual data and object, and/or aspecific mark or identification parameter of the object.

Additionally, with the visual data, the user of client device 110 mayprovide an offer for the object, such as a sale offer of an object thata user owns or a purchase offer for the object by a buyer. Transactionprocessor server 130 may then generate a virtual graphic or other visualindicator that may be associated with the object based on theidentifying characteristic so that other users may view the offer forthe object. For example, the virtual graphic may correspond to agraphical image, object, icon, or other displayable information that maybe overlaid over real-world images or video in the augmented realityexperience provided by augmented reality application 120. This may alsoinclude a graphical overlay and/or a modification of image/videoparameters for the item. The visual indicator or other virtual graphicmay correspond to highlighting, adding text, or placing another graphicon or near the item's visual representation, and/or may includeadjusting pixels, resolution, size, brightness settings, color gradient,or other image/video parameter. For example, the indicator may be doneby one or more of highlighting the item, adjusting a color gradient ofthe item, or adjusting a brightness of the item in the image, or mayinclude overlaying other images or graphics onto the item.

Augmented reality application 120 may also be used to view other objectsand previously established virtual graphics and/or indicators through anaugmented reality experience. For example, augmented reality application120 may capture a different scene having real-world objects withpreviously attached offers from other users. Using the identifyingcharacteristic, augmented reality application 120 and/or transactionprocessor server 130 may determine the offers for the real-world objectsusing the corresponding identifying characteristics, as well asprobabilistic models that the objects are the same, to display thevirtual graphics or indicators within the augmented reality experience.Thus, the captured audio and/or visual data by augmented realityapplication 120 may be used to determine an augmented reality experiencefor the real-world scene, where the visual indicators are displayed asgraphics by augmented reality application 120 overlaid or modifying thevisual output of the displayed environment. In this regard, augmentedreality application 120 may further allow a user to process transactionsusing transaction application 112.

Transaction application 112 may correspond to one or more processes toexecute software modules and associated devices of client device 110 toprovide electronic transaction processing for objects having sale orpurchase offers provided through visual indicators and other objects inan augmented reality experience provided by augmented realityapplication 120. In this regard, augmented reality application 120 maycorrespond to specialized hardware and/or software utilized by a user ofclient device 110 that provides transaction processing services or maydetect a transaction processing event, for example, through one or moreprocesses that provide an interface to permit the user to enter inputand other data for transaction information, for example, through aninput device (e.g., touch screen with a graphical user interface,keypad/keyboard, mouse, etc.) and/or through a data capture device(e.g., camera, other optical device, etc.). Such information may be usedto alter or process data from an augmented reality scene provided byaugmented reality application 120 that has real-world visual data, forexample, by adding account data and/or a contact identifier for anaccount, user or client device 110 and/or by processing a transactionfor an offer.

During virtual graphic generation and/or transaction processing,transaction application 112 may be utilized to select paymentinstrument(s) for use with the object or transaction. As discussedherein, transaction application 112 may utilize user financialinformation, such as credit card data, bank account data, or otherfunding source data, as a payment instrument when providing paymentinformation, including an account with transaction processor server 130.For example, transaction application 112 may utilize a digital walletassociated with an account with a payment provider, such as transactionprocessor server 130, as the payment instrument, for example, throughaccessing a digital wallet or account of a user with transactionprocessor server 130 through entry of authentication credentials and/orby providing a data token that allows for processing using the account.Transaction application 112 may also be used to receive a receipt orother information based on transaction processing. This data may beshared with transaction processor server 130 for use in trackinghistorical prices of an object through a blockchain.

In some embodiments, one or more of the processes of augmented realityapplication 120 and transaction application 112 may be provided withinthe same application so as to provide their services through a singleapplication.

In various embodiments, client device 110 includes other applications114 as may be desired in particular embodiments to provide features toclient device 110. For example, other applications 114 may includesecurity applications for implementing client-side security features,programmatic client applications for interfacing with appropriateapplication programming interfaces (APIs) over network 150, or othertypes of applications. Other applications 114 may also include email,texting, voice and IM applications that allow a user to send and receiveemails, calls, texts, and other notifications through network 150. Invarious embodiments, other applications 114 may include financialapplications, such as banking applications. Other applications 114 mayalso include other location detection applications, which may be used todetermine a location for the user, such as a mapping, compass, and/orGPS application, which can include a specialized GPS receiver thatobtains location information for client device 110 and provide thelocation for a particular object, scene, or other data associated withan augmented reality experience. Other applications may include socialnetworking applications, media viewing, and/or merchant applications.Other applications 114 may include device interface applications andother display modules that may receive input from the user and/or outputinformation to the user. For example, other applications 114 may containsoftware programs, executable by a processor, including a graphical userinterface (GUI) configured to provide an interface to the user. Otherapplications 114 may therefore use devices of client device 110, such asdisplay devices capable of displaying information to users and otheroutput devices, including speakers, which may display an augmentedreality to a user.

Client device 110 may further include database 116 stored in atransitory and/or non-transitory memory of client device 110, which maystore various applications and data and be utilized during execution ofvarious modules of client device 110. Thus, database 116 may include,for example, identifiers such as operating system registry entries,cookies associated with augmented reality application 120 and/ortransaction application 112, identifiers associated with hardware ofclient device 110, or other appropriate identifiers, such as identifiersused for payment/user/device authentication or identification, which maybe communicated as identifying client device 110 to transactionprocessor server 130. In various embodiments, database 116 may storereal-world images and/or virtual graphics or indicators for an augmentedreality, as well as offer data for the virtual data of the augmentedreality experience.

Client device 110 includes at least one network interface component 118adapted to communicate with transaction processor server 130 and/oranother device or server for electronic transaction processing. Invarious embodiments, network interface component 118 may include a DSL(e.g., Digital Subscriber Line) modem, a PSTN (Public Switched TelephoneNetwork) modem, an Ethernet device, a broadband device, a satellitedevice and/or various other types of wired and/or wireless networkcommunication devices. In some embodiments, communication device 110 mayalso communicate directly with nearby devices (e.g., merchant device130) using short range communications, such as Bluetooth Low Energy, LTEDirect, WiFi, radio frequency, infrared, Bluetooth, and near fieldcommunications.

Transaction processor server 130 may be maintained, for example, by anonline service provider, which may provide transaction processing andpayment services, as well as augmented reality services for virtuallytagging objects and associating those objects with offers for purchaseor sale. In this regard, transaction processor server 130 includes oneor more processing applications which may be configured to interact withclient device 110, and/or another device/server to facilitate anaugmented reality experience for object purchasing. In one example,transaction processor server 130 may be provided by PAYPAL®, Inc. of SanJose, Calif., USA. However, in other embodiments, transaction processorserver 130 may be maintained by or include another type of serviceprovider, which may provide connection services to a plurality of users.

Transaction processor server 130 of FIG. 1 includes a virtual taggingapplication 140, a transaction processing application 132, otherapplications 134, a database 136, and a network interface component 138.Virtual tagging application 140, a transaction processing application132, and other applications 134 may correspond to executable processes,procedures, and/or applications with associated hardware. In otherembodiments, transaction processor server 130 may include additional ordifferent modules having specialized hardware and/or software asrequired.

Virtual tagging application 140 may correspond to one or more processesto execute software modules and associated specialized hardware oftransaction processor server 130 to provide tagging of real-worldobjects with virtual data, including virtual graphics, text, and/orvisual indicators, in an augmented reality experience that may beprovided through augmented reality application 120. In this regard,virtual tagging application 140 may correspond to specialized hardwareand/or software to first receive visual data of a real-worldenvironment, for example, as client device 110 captures a scene througha camera and augmented reality application 120. Using the visual data,virtual tagging application 140 may identifying objects that a user hasselected, and particular identifying characteristics with the object. Insome embodiments, this may include detecting a geo-location of theobject, determining a time of tagging and/or capture of the object,and/or determining a specific visual mark or identifying feature of theobject that can be detected in other images or video. The identifyingcharacteristic may be selected by client device 110 and/or may furtherinclude data for an offer for the object, such as a purchase or sale.The offer may include selections of data or other options for generationof a virtual graphic or visual indicator for the offer to be displayedwith the object in the augmented reality experience. After generatingthe virtual graphic, virtual tagging application 140 may then store theoffer, virtual graphic, and other data with the identifyingcharacteristic so that the virtual graphic and offer details may bedisplayed in the augmented reality experience to other devices whencapturing the object by those other devices.

Virtual tagging application 140 may later receive additional visual datathat captures the object. For example, client device 110 or a similardevice may execute augmented reality application 120 (or a correspondingapplication) to capture visual data of a real-world scene. Virtualtagging application 140 may process the visual data to determine whetherthe visual data includes one or more identifying characteristics thatmatch the previously stored identifying characteristic. For example, ageo-location for the newly captured visual data may be compared to pastgeo-locations of objects. In this regard, the geo-location may also beprocessed using a probabilistic model whereby virtual taggingapplication 140 determines a probability that the object is stilllocated within an area or that the object may have traveled the distancebetween the geo-locations. If a match occurs or the model indicates asufficiently high probability of the object matching (e.g., over athreshold), then virtual tagging application 140 may display the virtualgraphic or visual indicator having the offer details through theaugmented reality experience capturing the new visual data of thereal-world scene. This may include overlaying graphics, adjusting visualparameters of the scene, or otherwise presented augmented realitydetails with the real-world images of the object. If the user acceptsthe offer for the object, transaction processing application 132 may beused to process a transaction for the object.

Transaction processing application 132 may correspond to one or moreprocesses to execute modules and associated specialized hardware oftransaction processor server 130 to process a transaction for one ormore objects have an associated offer tagged to the object in anaugmented reality experience. In this regard, transaction processingapplication 132 may correspond to specialized hardware and/or softwareused by a user associated with client device 110 to establish a paymentaccount with transaction processing application 132 by providingpersonal and/or financial information to transaction processor server130 and selecting authentication credentials. In various embodiments,the financial information may include payment instrument information,such as account/card numbers and information. The account may be used tosend and receive payments. The payment account may be accessed and/orused through a browser application and/or dedicated payment applicationexecuted by client device 110, such as transaction application 112.

In some embodiments, client device 110 may generate transaction data fora transaction for a real-world object based on a virtual graphic orindicator for an offer that is associated with the real-world object inan augmented reality experience, such as one provided through augmentedreality application 120. Thus, transaction processing application 132may interact with client device 110 to generate and process thetransaction data, which may include interacting with another device oraccount to process the transaction for the object. Transactionprocessing application 132 may receive a payment request from clientdevice 110 for the transaction data with the user's account, which mayinclude identifiers, tokens, or other data used for transactionprocessing. Transaction processing application 132 may process a paymentand may provide a transaction history to client device 110 and/oranother user's device or account for transaction authorization,approval, or denial of the transaction.

In various embodiments, transaction processor server 130 includes otherapplications 134 as may be desired in particular embodiments to providefeatures to transaction processor server 130. For example, otherapplications 134 may include security applications for implementingserver-side security features, programmatic client applications forinterfacing with appropriate application programming interfaces (APIs)over network 150, or other types of applications. Other applications 134may contain software programs, executable by a processor, including agraphical user interface (GUI), configured to provide an interface tothe user when accessing transaction processor server 130, where the useror other users may interact with the GUI to more easily view andcommunicate information. In various embodiments, other applications 134may include connection and/or communication applications, which may beutilized to communicate information to over network 150.

Additionally, transaction processor server 130 includes database 136.The user and/or the merchant may establish one or more digital walletsand/or accounts with transaction processor server 130. Digital walletsand/or accounts in database 136 may include user information, such asname, address, birthdate, payment instruments/funding sources,additional user financial information, user preferences, and/or otherdesired user data. Users may link to their respective digital walletsand/or payment accounts through an account, user, merchant, and/ordevice identifier. Thus, when an identifier is transmitted totransaction processor server 130, e.g., from client device 110, one ormore digital wallets and/or payment accounts belonging to the users maybe found. Database 136 may store augmented reality data for an augmentedreality experience that may be displayed to other devices, includingobject recognition data, identifying characteristics of objects forobject identification and recognition, virtual graphics and/or visualindicators for offers, and offers for objects including offer details,account identifiers, and/or contact identifiers.

In various embodiments, transaction processor server 130 includes atleast one network interface component 138 adapted to communicate clientdevice 110 and/or another device or server over network 150. In variousembodiments, network interface component 138 may comprise a DSL (e.g.,Digital Subscriber Line) modem, a PSTN (Public Switched TelephoneNetwork) modem, an Ethernet device, a broadband device, a satellitedevice and/or various other types of wired and/or wireless networkcommunication devices including microwave, radio frequency (RF), andinfrared (IR) communication devices.

Network 150 may be implemented as a single network or a combination ofmultiple networks. For example, in various embodiments, network 150 mayinclude the Internet or one or more intranets, landline networks,wireless networks, and/or other appropriate types of networks. Thus,network 150 may correspond to small scale communication networks, suchas a private or local area network, or a larger scale network, such as awide area network or the Internet, accessible by the various componentsof system 100.

FIG. 2A is an exemplary interface of a communication device displayingan augmented reality experience where a user is tagging an object withprovided data, according to an embodiment. Environment 200 a of FIG. 2Aincludes an interface 1000 of client device 110, for example,corresponding generally to an interface output through the describedfeatures, processes, and components of augmented reality application 120of client device 110 in system 100 of FIG. 1. In this regard, a userutilizing client device 110 may view interface 1000 on client device110, where interface 1000 corresponds to an interface displaying anaugmented reality experience, scene, or other data determined andgenerated by augmented reality application 120.

In this regard, interface 1000 includes an augmented reality display1002 that displays augmented reality data for an augmented realityapplication and experience. For example, a scene 1004 may displayreal-world data for an environment, as well virtual graphics and visualidentifiers overlaid or added to visual data for the real-worldenvironment. For example, a bike 1006 may be shown within scene 1004.Bike 1006 may include an identifying mark 1008, such as a characteristicor feature of bike 1006. This may include rare or uncommon features,such as a sticker, paint, scratch, or other visual appearance that maybe unique to bike 1006 or uncommon between bicycles in general. In someembodiments, the feature may be common but may be a feature of interestto the user so that the user would only like similar bikes sharing thatfeature. Scene also includes a virtual graphic or visualidentifier/indicator for a pointer 1010 that may be displayed withinscene 1004 based on a request by the user. Pointer 1010 thus correspondsto data not visual in the real-world but added to captured visual data.Additionally, another object, such as a house 1012, may be captured inin scene 1004 and associated bike 1006 so that bike 1006 may be moreeasily identified in other data captured of bike 1006 (e.g., when bike1006 is located in proximity to or at house 1012).

Furthermore, interface 1000 may also display further information with,nearby, or associated with augmented reality display 1002. Thisinformation may include options to add, alter, or remove data fromaugmented reality display 1002. For example, a pointer selection 1014may allow a user to utilize pointer 1010 to select bike 1006 for objectidentification and generation of a virtual graphic to purchase or sellbike 1006. Thus, a message 1016 informs the user to tap in scene 1004 togenerate and move pointer 1010. This allows a user to make selections inscene 1004 and refine the selection of bike 1006 through the use ofpointer 1010. Moreover, pointer selector 1014 may also allow changing ofpointer 1010 or other selections within scene 1004, such as by drawing abox over an object or circling an object.

Interface 1000 further allows for adding a geolocation tag ofgeolocation A 1018 and/or viewing the geolocation tag that will be addedto augmented reality data for scene 1004. Geolocation A 1018 may be usedto add identifying data and characteristics to bike 1006 so that bike1006 is associated with a geolocation. Similarly, a time 1020 may alsobe added to bike 1006 and/or the corresponding visual or augmentedreality data so that time 1020 may be associated with geolocation A 1018for bike 1006. This allows determination of whether bike 1006 may movewithin a probabilistic distance between geolocations. A user usingclient device 110 may also add marks 1022 to augmented reality data forscene 1004 and bike 1006. This may include selection of identifying mark1008 or selections of other features for bike 1006 so that otheridentifying characteristics may be identified. Thus, an option for markaddition 1024 for the augmented reality display may allow for selectionof identifying mark 1008 or another feature within scene 1004. Using anoffer option 1026, other offer data may be added to field 1028, such asa price of $100.00 that the user is willing to buy or sell bike 1006for. This information may also be associated with an account A 1030 thatmay be used to provide or receive payments, add a contact identifier, orother alter an offer.

FIG. 2B is an exemplary interface of a communication device displayingan augmented reality having tracked object data, according to anembodiment. Environment 200 b of FIG. 2B includes an interface 1100 ofclient device 110, for example, corresponding generally to an interfaceoutput through the described features, processes, and components ofaugmented reality application 120 of client device 110 in system 100 ofFIG. 1. In this regard, a user utilizing client device 110 may viewinterface 1100 on client device 110, where interface 1100 corresponds toan interface displaying an augmented reality experience, scene, or otherdata determined and generated by augmented reality application 120.

Interface 1100 displays an augmented reality display 1102 that displaysaugmented reality data for an augmented reality application andexperience. For example, a scene 1104 may display real-world data for anenvironment, as well virtual graphics and visual identifiers overlaid oradded to visual data for the real-world environment. For example, scene1104 may include objects previously captured in an augmented realityexperience by the same or another device. Scene 1104 may thereforedisplay data from the real-world and virtual data captured and generatedin environment 200 a FIG. 2A. In this regard, scene 1104 includes bike1006 and identifying mark 1008 previously discussed. These thereforecorrespond to the same objects and marks in environment 200 a. However,in other embodiments where a user does specifically request the same ormatching object, bike 1006 may correspond to a similar object within anacceptable range of similarity, which may be set by the user ordetermined based on a probability of matching model generated using anobject recognition engine.

Additionally, scene 1104 for augmented reality display 1102 includes avisual indicator 1105 for bike 1106 that shows bike 1006 is selected,highlighted, or otherwise identified as a point of interest for anoffer. Scene 1104 further includes a virtual graphic 1106 that displaysthe offer associated with bike 1006 and visual indicator 1105. Visualindicator 1105 and virtual graphic 1106 may be displayed in theaugmented reality experience for scene 1104 due to recognition ofidentifying mark 1008 for bike 1006 and/or house 1108. For example,identifying mark 1008 may be used to identify bike 1006 and/or house1108 may correspond to house 1012 in environment 200 a so that bike 1006is identified with a high degree of probability as matching betweendifferent captured virtual data. In further embodiments, a matchinggeolocation or probabilistic model for geolocation matching may also beused to display visual indicator 1105 and virtual graphic 1106, whichmay be based on times of captured virtual data and other information.

Furthermore, interface 1100 may also display further information with,nearby, or associated with augmented reality display 1102. For example,augmented reality objects 1110 may be used to display additionalinformation for virtual data that is displayed with objects in anaugmented reality experience. Thus, augmented reality objects maycorrespond to real-world objects, like bike 1006, that includes virtualdata for an augmented reality experience. This may include offer Adetails 1112 that may display additional information for the offerassociated with visual indicator 1105 and virtual graphic 1106. Forexample, price 1114 and contact identifier A 1116 are shown for offer Adetails 1112. Augmented reality options 1118 allow the user to interactwith augmented reality display 1102, such as buy process a buy option1120 and/or a sell option 1122. This may be done using an account B 1124with a transaction processor.

FIG. 3 is an exemplary system environment showing a communication deviceand a service provider server interacting to provide an augmentedreality to track object data, according to an embodiment. Environment300 of FIG. 3 includes client device 110 and transaction processorserver 130 discussed in reference to system 100 of FIG. 1.

Client device 110 includes augmented reality application 120corresponding generally to the processes and features discussed inreference to augmented reality application 120 in system 100 of FIG. 1.In this regard, augmented reality application 120 includes capturedaudio, video, and/or audiovisual data, as well as information processedfrom such data, such as real-world data and virtual data that may beutilized for an augmented reality experience viewed through anapplication device. For example, augmented reality application 120 mayinclude augmented reality data 2002 for a specific scene viewed througha camera or other optical capture device of client device 110. Augmentedreality data 2002 includes a scene 2004 having real-world visual data2006 captured through that camera or other visual capture component. Tocreate an augmented reality experience, real-world visual data 2006 maybe altered with virtual graphics 2008, which may correspond to overlays,visual indicators, or other alterations to a visual output of datathrough a graphical user interface of a device. Thus, one or more imagesor videos may be altered using virtual graphics 2008.

Virtual graphics 2008 may also include data utilized to determine aplacement of such data within scene 2004. For example, virtual graphics2008 may include scene placements 2010, which correspond to thenecessary data to place one or more virtual graphics within a scene.Identifying characteristics 2012 may be utilized to identify areal-world object within real-world visual data 2006. This may includegeolocations, time stamps, identifying visual marks, or other data thatallows association with a specific object, or a class of objects, withinan augmented reality experience. Further, offer data 2014 may beutilized to present the specific data for virtual graphic 2008 thatallows a buy or sell offer to be seen in real-time within that augmentedreality experience. Augmented reality application 120 may also includeaugmented reality processes 2016 to process data viewed with augmentedreality data 2002, which may include processing one or more of offers2018 from the augmented reality experience based on a sale offer 2020 ora purchase offer 2022.

Transaction processor server 130 includes virtual tagging application140 corresponding generally to the processes and features discussed inreference to virtual tagging application 140 in system 100 of FIG. 1. Inthis regard, virtual tagging application 140 may be used to providevisual tags, virtual graphics, or other data within an augmented realityexperience. For example, visual tagging application 140 may include anaugmented reality experience 2102, which may track augmented realitydata between multiple devices. Augmented reality experience 2102 mayinclude virtual graphics for augmented realities 2102, which includesthose virtual graphics 2008 that may be added to a real-world scenecapture by a device. Further, virtual graphics 2008 may be associatedwith geolocations 2104, identifying characteristics, 2012, and/or offerdata 2014 that may be added to just a scene. In order to determine thecorrelations between objects captured in different data, probabilitiesmodels 2106 may also be invoked, which may correspond to artificialintelligent engines that may utilize input to make specific predicationson whether objects can be correlated, such as using likelihood matches2108. Likelihood matches 2108 may correspond to those weights and otherdeterministic models that may be trained utilizing data from one or moreaugmented reality experiences.

FIG. 4 is a flowchart of an exemplary process for tagging objects inaugmented reality to track object data, according to an embodiment. Notethat one or more steps, processes, and methods described herein may beomitted, performed in a different sequence, or combined as desired orappropriate.

At step 402 of flowchart 400, visual data of an environment with a realobject is captured, where the visual data may correspond to images,video, and/or a scan of a real-world environment having the object. Thismay therefore be captured by a user's device, such as a mobile phone,wearable computing device, camera, or the like that includes an opticalcapture device. Additionally, an application, such as an augmentedreality application, may be used to capture the environment, which thenis further used to alter an output of the environment so that virtualgraphics and visual indicators may be displayed with the visual data. Atstep 404, the object and an identifying characteristic of the object isdetermined in the visual data. The object may be identified using objectrecognitions processes, which may identify the object based on visualpoints, marks, or other information in the visual data. For example, ahouse, vehicle, personal item, or sale item may be identified inreal-world data of the environment but identifying some features of theobject. Further, the identifying characteristic, including a location,mark, feature, time of capture, or other information that allow foridentification of the object by other devices similarly capturing visualdata of the object may be determined using the visual data.

In some embodiments, this may include requesting the user to select oridentify the identification information or characteristics of theobject. However, the user's device and/or a service provider server mayalso determine the identifying characteristic. For example, an objectfingerprint may be generated using the identifying characteristics ofthe object to create a set of data that assists in better identifyingthe object in visual data based on the different characteristics of theobject and a machine learning model. This may include capturing featuredata of the object, including those visual features that may beextracted from images of the object. Further, the identifyingcharacteristics may include metadata of the visual data, includinglocations and timestamps of capture of the object in visual data.Together, this data may be used to create an object fingerprint, whichis then stored and associated with the object. Using this informationand fingerprint with an augmented reality process for an augmentedreality experience, a virtual graphic for an offer for the object in theaugmented reality experience is determined, at step 406. Prior to this,an additional step 405 may occur where an offer for the object isreceived from the user, for example, an amount for the object, anidentifier for the user, or other information allowing for a purchase orsale of the object. However, the offer may also be determined based onother offers for the same or similar object, which may utilize adistributed ledger of offers from other devices that utilize theaugmented reality experience. At step 408, the virtual graphic and theidentifying characteristic are stored so that when the augmented realityexperience is utilized, the virtual graphic may be retrieved andpresented with the object through an application on a device. Thus, theobject's fingerprint in then updated with the virtual graphic for theaugmented reality experience. This allows the fingerprint of the objectbased on the identifying characteristics to be used to retrieve thevirtual graphic for the augmented reality experience.

Thereafter, the object is identified in another device's augmentedreality experience, at step 410. This may include utilizing theidentifying characteristic and an object recognition process todetermine the object is present in the augmented reality experiencebeing viewed on another user's device. Additionally, the same user mayalso view the object, for example, to see other offers for the object,which may also require object recognition. A probabilistic model may beused to determine whether the object is present in the other visualdata, for example, by determining which a high enough degree ofcertainty (e.g., over a threshold percentage or level) that the objectis present in the current visual data. At step 412, the virtual graphicis presented with the object in the augmented reality experience. Forexample, the virtual graphic may be overlaid on, combined with, or usedto adjust the visual data. The virtual graphic may allow forinteraction, such as selection for display of the offer, or maygenerally display all data for the offer. The virtual graphic furthermay allow for the user capturing the object to contact the user makingthe offer, such as to negotiate a price, agree to the offer, and/orprocess a transaction (e.g., using an online transaction processor). Apurchase request for the offer is then received at step 414. Thepurchase request may identify an account for both the users, which mayallow the purchaser to buy the object from the seller. Thereafter, thepurchase request is processed using an online transaction processor, atstep 416. This may include providing a payment to the account of theseller from the account of the buyer.

FIG. 5 is a block diagram of a computer system suitable for implementingone or more components in FIG. 1, according to an embodiment. In variousembodiments, the communication device may comprise a personal computingdevice (e.g., smart phone, a computing tablet, a personal computer,laptop, a wearable computing device such as glasses or a watch,Bluetooth device, key FOB, badge, etc.) capable of communicating withthe network. The service provider may utilize a network computing device(e.g., a network server) capable of communicating with the network. Itshould be appreciated that each of the devices utilized by users andservice providers may be implemented as computer system 500 in a manneras follows.

Computer system 500 includes a bus 502 or other communication mechanismfor communicating information data, signals, and information betweenvarious components of computer system 500. Components include aninput/output (I/O) component 504 that processes a user action, such asselecting keys from a keypad/keyboard, selecting one or more buttons,image, or links, and/or moving one or more images, etc., and sends acorresponding signal to bus 502. I/O component 504 may also include anoutput component, such as a display 511 and a cursor control 513 (suchas a keyboard, keypad, mouse, etc.). An optional audio input/outputcomponent 505 may also be included to allow a user to use voice forinputting information by converting audio signals. Audio I/O component505 may allow the user to hear audio. A transceiver or network interface506 transmits and receives signals between computer system 500 and otherdevices, such as another communication device, service device, or aservice provider server via network 150. In one embodiment, thetransmission is wireless, although other transmission mediums andmethods may also be suitable. One or more processors 512, which can be amicro-controller, digital signal processor (DSP), or other processingcomponent, processes these various signals, such as for display oncomputer system 500 or transmission to other devices via a communicationlink 518. Processor(s) 512 may also control transmission of information,such as cookies or IP addresses, to other devices.

Components of computer system 500 also include a system memory component514 (e.g., RAM), a static storage component 516 (e.g., ROM), and/or adisk drive 517. Computer system 500 performs specific operations byprocessor(s) 512 and other components by executing one or more sequencesof instructions contained in system memory component 514. Logic may beencoded in a computer readable medium, which may refer to any mediumthat participates in providing instructions to processor(s) 512 forexecution. Such a medium may take many forms, including but not limitedto, non-volatile media, volatile media, and transmission media. Invarious embodiments, non-volatile media includes optical or magneticdisks, volatile media includes dynamic memory, such as system memorycomponent 514, and transmission media includes coaxial cables, copperwire, and fiber optics, including wires that comprise bus 502. In oneembodiment, the logic is encoded in non-transitory computer readablemedium. In one example, transmission media may take the form of acousticor light waves, such as those generated during radio wave, optical, andinfrared data communications.

Some common forms of computer readable media includes, for example,floppy disk, flexible disk, hard disk, magnetic tape, any other magneticmedium, CD-ROM, any other optical medium, punch cards, paper tape, anyother physical medium with patterns of holes, RAM, PROM, EEPROM,FLASH-EEPROM, any other memory chip or cartridge, or any other mediumfrom which a computer is adapted to read.

In various embodiments of the present disclosure, execution ofinstruction sequences to practice the present disclosure may beperformed by computer system 500. In various other embodiments of thepresent disclosure, a plurality of computer systems 500 coupled bycommunication link 518 to the network (e.g., such as a LAN, WLAN, PTSN,and/or various other wired or wireless networks, includingtelecommunications, mobile, and cellular phone networks) may performinstruction sequences to practice the present disclosure in coordinationwith one another.

Where applicable, various embodiments provided by the present disclosuremay be implemented using hardware, software, or combinations of hardwareand software. Also, where applicable, the various hardware componentsand/or software components set forth herein may be combined intocomposite components comprising software, hardware, and/or both withoutdeparting from the spirit of the present disclosure. Where applicable,the various hardware components and/or software components set forthherein may be separated into sub-components comprising software,hardware, or both without departing from the scope of the presentdisclosure. In addition, where applicable, it is contemplated thatsoftware components may be implemented as hardware components andvice-versa.

Software, in accordance with the present disclosure, such as programcode and/or data, may be stored on one or more computer readablemediums. It is also contemplated that software identified herein may beimplemented using one or more general purpose or specific purposecomputers and/or computer systems, networked and/or otherwise. Whereapplicable, the ordering of various steps described herein may bechanged, combined into composite steps, and/or separated into sub-stepsto provide features described herein.

The foregoing disclosure is not intended to limit the present disclosureto the precise forms or particular fields of use disclosed. As such, itis contemplated that various alternate embodiments and/or modificationsto the present disclosure, whether explicitly described or impliedherein, are possible in light of the disclosure. Having thus describedembodiments of the present disclosure, persons of ordinary skill in theart will recognize that changes may be made in form and detail withoutdeparting from the scope of the present disclosure. Thus, the presentdisclosure is limited only by the claims.

What is claimed is:
 1. A service provider system comprising: anon-transitory memory; and one or more hardware processors coupled tothe non-transitory memory and configured to read instructions from thenon-transitory memory to cause the service provider system to performoperations comprising: receiving first image data for a first image ofan object being viewed by a first user via an augmented realityapplication of a first device; determining an identifying characteristicassociated with the object based on the first image data; associating anidentifier with the object based on the identifying characteristic,wherein the identifier is accessible by other users of the augmentedreality application; detecting a first offer for a first purchase of theobject from the first device; generating a first visual indicatorcorresponding to the first offer; and associating the first visualindicator with the object, wherein the first visual indicator isviewable by users of the augmented reality application that are within athreshold distance of the object.
 2. The service provider system ofclaim 1, wherein the operations further comprise: receiving second imagedata for a second image from a second device of a second user;determining that the second image comprises the object using aprobabilistic model for object identification; and causing the firstvisual indicator to be displayed with the object in the second imagedata.
 3. The service provider system of claim 2, wherein the identifiercomprises a geo-location of the object, and wherein the probabilisticmodel is based on at least one of a predicted travel distance of theobject over a time period or a number of instances of the object withinthe geo-location associated with the object.
 4. The service providersystem of claim 1, wherein the determining the identifyingcharacteristic comprises receiving the identifying characteristic fromthe first device based on a selection of a portion of the object withinthe first image.
 5. The service provider system of claim 1, wherein theoperations further comprise: receiving second image data for a secondimage from a second device of a second user; determining that the secondimage comprises the object based on the identifying characteristic inthe second image; and causing the first visual indicator to be displayedwith the object in the second image data.
 6. The service provider systemof claim 5, wherein prior to the causing, the operations furthercomprise: authenticating that the second user is an owner of the object,wherein the causing is in response to the authenticating.
 7. The serviceprovider system of claim 6, wherein the operations further comprise:receiving an acceptance of the first offer from the second user; andprocessing a sale of the object to the first user based on theacceptance and the authenticating.
 8. The service provider system ofclaim 6, wherein the authenticating that the second user is the ownercomprises: analyzing an ownership document for the object; and verifyingthat the second user is the owner of the object based on the ownershipdocument.
 9. The service provider system of claim 5, wherein theoperations further comprise: receiving a second offer for the objectfrom the second user; and adding the second offer to one of the firstvisual indicator or a second visual indicator for the object.
 10. Theservice provider system of claim 1, wherein the associating the firstvisual indicator to the object comprises storing the first offer and thefirst visual indicator with the identifier in a record database.
 11. Theservice provider system of claim 10, wherein the record databasecomprises a blockchain record of at least the first offer distributed toa plurality of other devices.
 12. A method comprising: capturing animage of an object in an augmented reality scene recorded by anapplication on a mobile device of a first user, wherein the image isassociated with image metadata from the augmented reality scene recordedby the mobile device; receiving a purchase offer of the object from thefirst user via the augmented reality scene recorded by the mobile deviceof the first user; in response to the receiving, determining anidentifying mark of the object based on the image; determining ageo-location of the object based on the image metadata; creating avirtual graphic for the purchase offer within the augmented realityscene; and tagging the object within the augmented reality scene withthe virtual graphic, wherein the object is tagged based on theidentifying mark and the geo-location.
 13. The method of claim 12,wherein the object comprises one of a plurality of objects, and whereineach of the plurality of objects is further tagged with the virtualgraphic within the augmented reality scene.
 14. The method of claim 13,further comprising: receiving at least one additional image of adifferent one of the plurality of objects from a second user;determining that the at least one additional image comprises the objectbased on the geo-location and the identifying mark; and displaying thevirtual graphic with the different one of the plurality of objects inthe augmented reality scene to the second user.
 15. The method of claim14, wherein the purchase offer further comprises a contact identifierfor the first user, and wherein the virtual graphic is displayed withthe contact identifier for the first user to the second user in theaugmented reality scene.
 16. The method of claim 14, wherein thedetermining that the at least one additional image comprises the objectis further based on a number of the plurality of objects within an areaassociated with the geo-location.
 17. A non-transitory machine-readablemedium having stored thereon machine-readable instructions executable tocause a machine to perform operations comprising: receiving visual dataof an item for sale by a first user from a first device of the firstuser, wherein the visual data comprises a geo-location tag of the itemidentifying the item to an object recognition operation of an augmentedreality experience; receiving a sale offer of the item from the firstdevice, wherein the sale offer comprises a contact identifier of thefirst user; generating a graphical object for the item in the augmentedreality experience based on the sale offer and the contact identifier;linking the graphical object to the item in the augmented realityexperience; receiving an image within the augmented reality experiencefrom a second device of a second user; determining that the imageincludes the item based at least on the geo-location tag; and displayingthe graphical object within the augmented reality experience on thesecond device, wherein the graphical object is associated with the itemin the augmented reality experience.
 18. The non-transitorymachine-readable medium of claim 17, wherein the geo-location tagcomprises a device identifier for one of the first device or a thirddevice associated with the item, wherein the device identifier allowsGPS lookup of the first device or the third device for geo-locationdetection of the item.
 19. The non-transitory machine-readable medium ofclaim 17, wherein the visual data comprises one of a plurality ofimages, a video, or a three-dimensional scan of the item, wherein thevisual data further comprises a selection of an identifying mark on theitem, and wherein the graphical object is further associated with theitem based on the identifying mark
 20. The non-transitorymachine-readable medium of claim 17, wherein the operations furthercomprise: receiving a purchase offer of the item from the second device;and notifying the first user of the purchase offer via the augmentedreality experience.